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Abstract. We test a Markov chain approximation to the segment descrip- 
tion (Li, 2007) of chaos (and turbulence) on a tent map, the Minea system, 
the Henon map, and the Lorenz system. For the tent map, we compute the 
probability transition matrix of the Markov chain on the segments for seg- 
ment time length (iterations) T = 1,2,3,100. The matrix has 1,2,4 tents 
corresponding to T = 1, 2, 3; and is almost uniform for T = 100. As T — > +oo, 
our conjecture is that the matrix will approach a uniform matrix (i.e. every 
entry is the same). For the simple fixed point attractor in the Minea system, 
the Reynolds average performs excellently and better than the maximal prob- 
ability Markov chain and segment linking. But for the strange attractors in 
the Henon map, and the Lorenz system, the Reynolds average performs very 
poorly and worse than the maximal probability Markov chain and segment 
linking. 
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1. Markov Chain Approximation 

In [3] , we showed that any orbit inside an attractor (chaotic or turbulent attrac- 
tors are the most interesting ones) can be uniformly approximated on the infinite 
time interval t 6 [0, oo) by an infinite sequence of segments out of a finite number 
of segments. The attractor (or its attracting neighborhood) is partitioned into N 
small neighborhoods {A n } n= i^,-- ,at. Each neighborhood A n is attached with an 
orbit segment s n over a fixed time interval t g [0, T]. Denote by f * the evolution 
operator. The flow tube iJ t ^Q t j^F t {A n ) is approximated by the segment s n . If 
F T (A n ) n A m ^ 0, then the flow tube ^t^[T,2T]F t {F T (A n ) H A m ) is approximated 
by the segment s m . This process can be continued to t — > oo. If we re-distribute the 
Lebesgue measure of F T (A n ) n A m uniformly on A m (i.e. we assume the points in 
F T (A n ) PiA m as random points with uniform probability distribution in A m ), then 
we obtain a Markov chain approximation. When A„s are small and the attractor 
has good mixing properties, we expect this Markov chain approximation to perform 
very well. The key element for this Markov chain approximation is the transition 
matrix [2], pQ 

(1) A = ( Pu ) , 

where 

_ /i(F T (^)n^) 

Pij fi(F T (Aj)) ' 
and /i is the Lebesgue measure. We can simply label A n and s n by the letter n. 
Then our Markov chain is defined by the transition matrix A acting on N letters 
{1,2,. •• ,N}. 



2. Ulam Approximation 

The Transfer Operator (Perron-Frobenius Operator) is defined as, 

N 

(2) v n+l {A) = v n {F~ T (A)) = Y,"n(F~ T (A) fli 3 ), 

3=1 

where z^ n 's are measures. The Ulam approximation of the transfer operator is 
defined as, 

, ^^ KF- T (A)nA j ) . A . 

j=l 

where /i is the Lebesgue measure. If we re-distribute v n (F~ T {A) (1 Aj) uniformly 
on Aj (i.e. we assume the points in F T (A) n Aj as random points with uniform 
probability distribution in Aj), then we obtain the Ulam approximation by 



v n (F~ T (A) nAj)~ ^ — y;\-'^' Vn {Aj) 



^(F- T (A)nA j ) 

KAj) 



The transition matrix of the Ulam approximation is 

(4) P={°ii) » 

where 

_ fi(F~ T (Aj) n Aj) 
KAj) 
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If F T is 1 — 1 and we replace the partition {Ai} by {F T (Ai)}, then 

_ n{Aj n F T (Aj)) _ 

fi(F T (Aj)) ~ Pij - 

3. Asymptotic Cycles 

Using the segments {s n } n —i t 2,-- ,n, one can identify certain pseudo-orbits (called 
segment linking orbits) and the associated sequence of A„'s: 

^n_2 ^n_i 

... 4 A A A A 

2 71— 1 ^Ilo ^71 1 ' rL U2 

where s n . attaches to A nj and the end point of s nj belongs to A n . +1 (recall also 
that the starting point of s nj belongs to A n .). Since there are only finite s„'s; 
as rij — > +oo, some s nj has to repeat itself, then all the segments after it repeat 
themselves too. Thus all these pseudo-orbits are always asymptotic to cycles: 

s ™n ' ' ' Sn 3 k Sn ii ' ' ' Sn 3 k 
where k can be 1 in which case the asymptotic cycle is a "fixed point" . 



4. Transition Matrix 

We shall compute the transition matrix for the tent map: 

X n +l = f{x n ), X n € [0, 1]; 

where 

f(x n ) = — (x n < a), f(x n ) = — — — (x n > a); 
a a — 1 

and a is a parameter a € (0, 1). We choose a = 1/3. We break the interval [0, 1] 

into 20 subintervals. Take 100 initial conditions in each subinterval. For each initial 

condition xq in the i-th subinterval, we compute xt as the T-iteration starting from 

xq. If xt belongs to j-th subinterval, we increase the (j, z)-th entry of the transition 

matrix by . Initially all the entries of the transition matrix are set to 0. Since the 

iterated map f T has 2 T_1 tents, the transition matrix also resembles this pattern. 

Our conjecture is that when T — > +oo, the transition matrix approaches a uniform 

matrix with every entry being 1/20. See Figure [l] for an illustration. 

5. Different Types of Orbits 

We shall compute several types of orbits: 

(1) The true orbit. It is computed by Runge-Kutta method for differential 
equations, and by iterations for maps; for a time interval t G [0,T*]. 

(2) The segment orbit. First we cut the total time interval [0,T*] into 
subintervals of length T. The interested region in the phase space, where 
the attractor lives is partitioned into iV small neighborhood {A n } n= i i2 ,... ,jv 
(usually squares or cubes). If at time t — jT, the true orbit lands in some 
A n , then (j + l)-th segment will be the one attached to A n (usually this 
segment is computed with the initial condition at the center of the square 
or cube for a time length of T). For j = 0, 1, 2, • • • ; all the segments to- 
gether form the segment orbit. It is a uniform approximation of the true 
orbit for all positive time. 
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(3) The segment linking orbit. If the initial condition of the true orbit 
lands in some A n , then the first segment will be the one attached to 
A n . If the first segment ends in some A m , then the second segment will 
be the one attached to A m . By repeating this process, we generate the 
segment linking orbit. As discussed in Section [3j the segment linking orbit 
is asymptotic to some cycle. The segment orbit uniformly approximates 
a particular orbit in the basin of attraction, while the segment linking 
orbit only uses the initial condition of the true orbit, and is not a uniform 
approximation of the true orbit. In reality, the segment orbit is difficult 
to obtain without the full knowledge of the true orbit, while the segment 
linking orbit is trivial to obtain once all the segments attached to the A n 's 
are known. 

(4) The maximal probability Markov chain. If the initial condition of the 
true orbit lands in some A n , then the first segment will be the one attached 
to A n . Then we test many random initial points in A n , see where they 
land at time t = T, and we pick maximal probability partition clement 
A m . The second segment will be the one attached to A m . Repeating the 
process, we generate the maximal probability Markov chain. 

(5) The Reynolds average orbit. We pick initial conditions near the initial 
condition of the true orbit, compute the orbit corresponding to each initial 
condition, at each t > 0, we do an algebraic average of all the orbits, then 
we get the Reynolds average orbit. 

Overall, the segment orbit is a uniform approximation of a particular orbit, 
while the segment linking orbit, the maximal probability Markov chain and the 
Reynolds average orbit are all aiming at certain average property of the attractor. 



6. Minea System 

Consider the Minea system 



dui 
~dt 
du 2 

~dt 



= 1 — u\ — 5u 2 , 
= Suiu 2 — u 2 ; 



where (u 1; u 2 ) G (0,1) x (0,1) and 6 is a parameter. When S > 1, all the orbits 
converge to one point [6]. We choose 5 = 5 for our simulations here. The total 
simulation time T* — 10, while the segment time T = 1 (i.e. 10 segments along 
each orbit). The interested region in the phase plane is (ui,u 2 ) € (0, 1) x (0, 1). We 
cut this unit square into 60 x 60 subsquares (i.e. the A n 's). The segment attached 
to each A n starts from the center of A n . The true orbit starts from the initial point 
( 5^,0.5 + yIo)- F° r the calculation of the maximal probability Markov chain, we 
test 1000 random initial points in A n . For the calculation of the Reynolds average 
orbit, we pick 4 initial conditions within ^ distance from the initial condition 
of the true orbit. The results are shown in Figure [2j As expected, the Reynolds 
average orbit is a better approximation of the true orbit than the other types of 
orbits. 
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7. Henon Map 

Consider the Henon map 

x„+i = y n + l- lAxl, 
y n+1 = 0.3x„. 

The total simulation time T* = 1000 (iterations), while the segment time T = 
250 (i.e. 4 segments along each orbit). The interested region in the phase plane is 
(x n ,y n ) € (—2,2) x (—2,2). We cut this square into 40 x 40 subsquares (i.e. the 
A n 's). The segments attached to each A n starts from the center of A n . The true 
orbit starts from the initial point (0.631354477,0.189406343). For the calculation 
of the maximal probability Markov chain, we test 1000 random initial points in A n . 
For the calculation of the Reynolds average orbit, we pick 2 or 4 initial conditions 
within 10~ 6 distance from the initial condition of the true orbit. The results are 
shown in Figure [3| One thing is clear, that is, the Reynolds average orbits are 
definitely bad approximations to the true orbit, and bad descriptions of the strange 
attractor. 



a(y-x), 
x(b - 25z) 
25xy — cz, 



8. Lorenz System 

Consider the Lorenz system 

dx 
~dt 
dy 
dt 
dz 
di 

where we choose a = 10, b = 28, c = 8/3. 

The total simulation time T* = 100, while the segment time is either T = 10 
(i.e. 10 segments along each orbit) or T = 1 (i.e. 100 segments along each orbit). 
The interested region in the phase space is (x, y, z) e (—0.8, 0.8) x (—1, 1) x (0, 2). 
We cut this region into 16 x 16 x 16 subregions (i.e. the A n 's). The segments 
attached to each A n starts from the center of A n . The true orbit starts from 
the initial point (0.1,0,0). For the calculation of the maximal probability Markov 
chain, we test 1000 random initial points in A n . For the calculation of the Reynolds 
average orbit, we pick 2 or 4 initial conditions within 0.05 distance from the initial 
condition of the true orbit. The results are shown in Figures [4] and [5j Once again 
the Reynolds average orbits are definitely bad approximations to the true orbit, and 
bad descriptions of the strange attractor. Naturally as the number of the segments 
along an orbit increases, the segment linking orbit and the maximal probability 
Markov chain deviate further away from the true orbit. 

9. Conclusion and Discussion 

As discussed in details in [3] [4] [5] , an effective description of turbulence means 
a solution to the problem of turbulence. An effective description of chaos is also 
very useful in applications of chaos theory. 

It is dangerous to draw strong conclusion with limited numerical experiments. 
But it is clear from these numerical experiments here that the Reynolds average is a 
terrible description of strange attractors. The segment description has the potential 
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to generate useful descriptions of strange attractors. Both the segment linking and 
the Markov chain have the potential to generate useful characterizations on certain 
average properties of the strange attractors. 

Traditionally the Reynolds average is based upon the setup of typical orbits 
being high frequency oscillations around a mean orbit. This is not the case inside a 
strange attractor. Therefore, one should not expect that the Reynolds average can 
be a good description on any sort of average property of the strange attractor. For 
the segment description, computing the segments can be costly if the partition is 
fine enough. Computing the segment orbit associated with a true orbit needs the 
full knowledge of the true orbit. So the potential of the segment description lies at 
the statistics of the segments rather than any individual segment orbit. Segment 
linking is a convenient way to start the study on the statistics of the segments. 
Markov chain is a first level study on the statistics of the segments. Practically it 
is very costly to generate the probability transition matrix for the Markov chain. 

Finally what kind of average properties that a strange attractor may possess 
are not clear at all. If the strange attractor has ergodicity, then tracking one orbit is 
enough to get a good picture of the strange attractor. On the other hand, especially 
in higher dimensions, often the chaotic (turbulent) dynamics is transient. What 
kind of average properties that such transient dynamics may possess are even less 
clear. 
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1,1! 11! 1,11 1,1! 1,11 1,16 1,17 1,14 111 1,17 11! 1,1! 1,11 1,11 11! 1,1! 1,1! 1,1! 1,14 1,14 
Will 1)1 1,1! 1)1 11! 1)7 1,16 11! 114 11! 1,16 1,1) 11! 11! ),)! 1,14 Dill! It! 
1)4 11! 11! 1,11 1,1! 1,1! 1,1! 1,11 1,1! 1,11 111 1,11 1,11 1)1 111 117 1,11 1)4 1,11 1,16 
Dill! 114 1,1! 1,1! 114 1)7 1,11 1)1 Hi 10),)! 1,11 1)1 11! 1)1 1,14 ),)! 11! 1)1 
DID) 1,11 1,1! 1,11 1,1! 1,1! 1,1! 1,11 1,14 11! 1,11 1,1! 1,17 11! 1,14 1,1! 1,1! 11! 11! 

(d) T = 100 



Figure 1. Transition matrices for the tent map 
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Oil 




1 05 1 OS 02 iS 3 35 05 1 15 3 35 3 35 

(a) true orbit (b) segment orbit 

I 1 1 1 1 1 1 1 0.55 1 1 1 1 1 1 1 1 




05 1 15 3 35 3 35 05 1 15 3 35 3 35 

(c) segment linking orbit (d) maximal probability Markov chain 

0.55 1 1 1 1 1 1 1 1 




05 1 15 3 35 3 35 

(e) Reynolds average orbit 

FIGURE 2. Different types of orbits for the Minea system. 
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-15 -1 -05 05 1 15 



(a) true orbit 




-1 5 -1 -0 5 5 1 1 5 



(c) segment linking orbit 




-0.4 ' 1 ' 1 1 1 

-1 5 -1 -0 5 5 1 1 5 




-1 5 -1 -0 5 5 1 1 5 

(b) segment orbit 




-1 5 -1 -0 5 5 1 1:5 

(d) maximal probability Markov chain 



0.4 




-03 1 1 1 1 1 1 1 1 1 

-0 8 -0 6 -04 -0 ? 02 0.4 0.6 8 1 11 



(e) Reynolds average orbit (of 2 orbits) (f) Reynolds average orbit (of 4 orbits) 

Figure 3. Different types of orbits for the Henon map. 
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(e) segment linking orbit (100) 

Figure 4. Different types of orbits for the Lorenz system (part 1). 
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(c) Reynolds average orbit (of 2 orbits) (d) Reynolds average orbit (of 4 orbits) 

Figure 5. Different types of orbits for the Lorenz system (part 2). 



